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Abstract 

Early identification of school alienation is of great importance for students’ educational 
outcomes and successful participation in society. This study examined the psychometric 
characteristics of a newly developed assessment instrument, the School Alienation Scale 
(SALS), to measure school alienation among primary and secondary school students. The 
SALS consists of three school-related domains, namely, classmates, teachers, and learning. 
Based on the responses of Swiss (1) and Luxernbourgish (2) students from two school- 
specific cohorts —primary (grade 4; ni=486, n2=503) and secondary schools (grade 7; 
rii-550, n2—534), we assessed instrument reliability, validity, and cross-cultural 
equivalence. The scale showed evidence of reliability and internal validity across two 
samples, confirming that the hypothesized first-order three-factor model fits the data better 
than several alternative models. The results of measurement invariance tests revealed that 
the measurement model operated equally well for primary and secondary school students 
in both countries. The construct validity of the SALS was additionally supported by 
demonstrated criterion-related validity. Specifically, school alienation domains were 
negatively associated with positive attitudes to and enjoyment in school; social problems 
in school were positively related to alienation from classmates and teachers. Our key 
contributions to the measurement of school alienation are the disclosure of the core 
domains of school alienation, development of a reliable and valid instrument, and 
justification for its use. Therefore, the results of this study have importan t implications for 
further theoretical work in alienation research and contribute to comparative research by 
examining the construct of school alienation in different educational settings. 
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1. Introduction 

Education crucially supports successful participation in society and develops the existing body of 
knowledge. A knowledge base and skills acquired through schooling provide individuals opportunities to act 
effectively in a rapidly changing world. Additionally, only a well-educated population can contribute 
significantly to the community and the economy (Becker, 1994; Seetanah, 2009; Vila, 2000; Zhang & Zhuang, 
2011). For these reasons, societies have a genuine interest in providing young people various educational 
opportunities. However, children’s learning begins when they are born (Krumboltz, 2009) when they start 
observing their environment, and it continues throughout their lifetime. Indeed, the majority of young children 
come to school filled with curiosity, creativity, and a strong desire to learn (Lumsden, 1994). 

However, there is substantial evidence that students’ intrinsic academic motivation and interest in 
learning at school significantly decline over time (Eccles & Midgley, 1990; Gottfried, Fleming, & Gottfried, 
2001; OECD, 2004). Not only do these processes co-occur with considerable social, physical, cognitive, 
emotional, and behavioral changes during adolescence (Eccles, Brown, & Templeton, 2008; Schunk & Meece, 
2005), but they are also associated with significant changes in family relations, peer affiliation, school and 
home environments (Schunk & Meece, 2005). Such shifts can be accompanied by school alienation, 
delinquency, and dropping out of high school (Eccles & Gootman, 2002), pointing to a mismatch between 
adolescents’ needs and their environments (Archambault, Janosz, Morizot, & Pagani, 2009b; Eccles & 
Midgley, 1989). In other words, adolescents whose environments do not fulfill their needs are more likely to 
become psychologically and physically disengaged, and eventually alienated from school (Eccles & Roeser, 
2009; Gutman & Eccles, 2007). 

The rising interest in school alienation has led to a better understanding of the phenomenon per se 
(Hadjar & Lupatsch, 2010; Hascher & Hadjar, 2017; Hascher & Hagenauer, 2010). Much less attention, 
however, has been paid to the development and validation of instruments that measure school alienation. To 
ensure meaningful inferences from a theoretical construct and to justify instrument use for further research and 
praxis, it is of utmost importance to carefully design and validate the construct of school alienation (Arnold, 
Arad, Rhoades, & Drasgow, 2000; Clark & Watson, 1995). Moreover, measurement validation is inevitably 
bound to theory development and theory testing (Zumbo, 2009). Thus, construct validity, based on theoretical 
and statistical evidence, lies at the heart of the present study. 

In this study, we introduce a new multidimensional perspective on school alienation. In particular, we 
developed the School Alienation Scale (SALS) as an assessment instrument used in the binational research 
project, School Alienation in Switzerland and Luxembourg (SASAL), to identify students’ negative attitudes 
toward classmates, teachers, and learning during primary and secondary education. Such measurement enables 
gathering important data about the issues students face in daily school life. Unlike previous studies on school 
alienation (e.g., Martin, 2008; Newmann, 1992; Rovai & Wighting, 2005), which consider a single academic 
setting (e.g., American secondary schools, virtual classrooms), we examined the development of school 
alienation in different educational settings — Switzerland and Luxembourg. The selection of these countries, 
which have some differences and share some similarities, is meaningful from the perspective of comparative 
educational research. In addition, comparative research enables testing the instrument in various settings and 
provides additional evidence of construct validity. The main objectives of this research are to gain a thorough 
understanding of the phenomenon of school alienation and to develop and validate a new theoretically-based 
measure of school alienation. 

Here, we first describe the major concepts of school alienation, followed by the guiding theoretical 
issues regarding instrument construction. Second, we provide data on instrument reliability, validity, and cross- 
cultural equivalence, based on research conducted in Luxembourg and the Swiss canton of Bern. Parallel 
analyses were conducted across primary and secondary school students and across countries to demonstrate 
the replicability of findings. Finally, we discuss the study’s results and implications for future research. 
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1.1 Conceptualization of school alienation 

The term alienation comes from the Latin alienatus, meaning “estranged,” which in turn originated 
from alius, meaning “other” or “another” (Watt, 2000). The concept of alienation has been introduced from 
sociological, psychological, philosophical, theological, and historical perspectives and applied to various 
contexts. For example, Marx primarily focused on the concept of alienation in the economic system. Moreover, 
subsequent alienation research has shown that the problem of alienation also arises in highly centralized and 
formalized organizations (Blauner, 1964; Aiken & Hage, 1966), family life (Kelly & Johnston, 2001), work 
settings (Hirschfeld & Feild, 2000; Shantz, Alfes, & Truss, 2014) as well as religious (Exline, Yali, Sanderson, 
2000), political (Finifter, 1970; Seeman, 1975; Pantoja & Segura, 2003), and medical contexts (Young, 1984). 
Although alienation appears to be a strictly contextual construct (Safipour, Schopflocher, Higginbottom, & 
Emami, 2011), at a general level it may be characterized as a kind of estrangement, distancing, or separateness 
from a former or a normal state, leading to some sort of loss (Railton, 2013). 

So far, relatively little is known about alienation in educational settings. However, recent studies 
essentially contributed to the development of school alienation research, specifying the characteristics of 
educational and social learning environments necessary for the prevention of school alienation (Dickey, 2004; 
Hadjar, Backes, & Gysin, 2015; Hadjar & Lupatsch, 2010; Hascher & Hadjar, 2017; Hascher & Hagenauer, 
2010; Osin, 2009). Oftentimes, youngsters who like school at the beginning may later become estranged from 
learning and develop negative attitudes toward school, hurtling into school alienation, and over time, even into 
dropping out (Archambault et al., 2009b; Eccles & Alfeld, 2007). Different students, whether they study in 
elite private or inner-city schools, undoubtedly experience the same problem (Sidorkin, 2004). Moreover, it is 
especially in adolescence that youth often deal with numerous stressful situations at school (Safipour et al., 
2011). For example, students who see little practical value in learning and its relevance outside of school, who 
experience poor relationships with teachers, or who suffer because of classmates may feel like outsiders. In 
the framework of the SASAL project, we conceptualize this feeling of estrangement from the social (i.e., 
classmates and teachers) and academic aspects of schooling (i.e., learning), including cognitive and emotional 
components, as school alienation (Hascher & Hadjar, 2017). In a school mostly free of alienation, we would 
expect students to maintain courteous relationships with classmates and school staff members and to engage 
actively and meaningfully in classroom and school activities. 

Suffice it to say that educational alienation cannot be dismissed as a temporary aberration, as it is 
rather a part of education (Sidorkin, 2004). There is a strong likelihood that adolescents who are alienated from 
school will not accomplish their basic educational goals (Archambault, Janosz, Fallu, & Pagani, 2009a). As a 
result, alienated students leave school with numerous negative experiences, including deviant behaviors, 
difficulties in fitting in, low participation in school activities, depression, running away, early sexual activity, 
conflicts with families, school withdrawal, limited education, failed attachment to school, or a lack of interest 
in further academic qualification (Brown, Higgins, & Paulsen, 2003a; Farrow, 1991; Frey, Ruchkin, Martin, 
& Schwab-Stone, 2009; Hascher & Hagenauer, 2010; Tarquin & Cook-Cottone 2008). School alienation can 
therefore lead to a process of exclusion from a society that is increasingly based on learning. Hence, the early 
diagnosis and understanding of school alienation are of great importance for the community, including 
educators, school staff members, and parents (Brown et al., 2003a; Stamm, Kost, Suter, Holzinger, & Stroezel, 
2011 ). 

Currently, most measurements of school alienation draw upon some of the alienation categories 
addressed by Seeman (1959) and Dean (1961), including powerlessness, meaninglessness, normlessness, 
isolation, and self-estrangement (e.g., Brown, Higgins, Pierce, Hong, & Thoma, 2003b; Mau, 1992). For 
example, recent studies explicitly focused on the four alienation dimensions most closely associated with the 
school context, namely, powerlessness, meaninglessness, normlessness, and social estrangement (Brown et 
al., 2003b; (j'aglar, 2013; Kocayoriik & Simsek, 2015; Mau, 1992). Similarly, another study developed an 
alienation-based framework for student experience in higher education, concentrating on the three categories, 
such as powerlessness, meaninglessness, and self-estrangement (Barnhardt & Ginns, 2014). Despite the 
relative popularity of recognizing the above-mentioned categories as an alienation construct, only a very 
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limited number of studies have measured it (Brown et al., 2003b). Some researchers have addressed the 
phenomenon of school alienation by investigating its correlates. Correlations are demonstrated repeatedly, for 
example, between school alienation and student participation (Altenbaugh, Engel, & Martin, 1995; Carlson, 
1995; Newmann, 1992), between school alienation and academic achievement (Johnson, 2005; Reinke & 
Herman, 2002), between school alienation and teacher and peer support (Altenbaugh et al., 1995; Ghaith, 
Shaaban, & Harkous, 2007; Hascher & Hagenauer, 2010), and between school alienation and school 
withdrawal (Liu, 2010). Murdock (1999) has focused on the behavioral aspect of school alienation, based on 
engagement in school tasks and self-reported disciplinary problems. Further, the phenomenon of school 
alienation was also studied in the context of motivation research, especially in regard to student 
(dis)engagement. Some researchers used the term disengagement as a synonym for school alienation 
(Altenbaugh et al., 1995), although later they described a vicious cycle in which alienation encourages further 
disengagement leading to more alienation. Alienation was also described as a subdimension of academic 
amotivation (Legault, Green-Demers, & Pelletier, 2006). Another empirical study viewed engagement as a 
positive counterpart to alienation (Case, 2008). However, the shortcomings of those approaches lie in the 
finding that the two constructs are not symmetrically opposite (Schabracq & Cooper, 2003). 

A variety of viewpoints in alienation research indicates a lack of consistency among the 
operationalizations of school alienation. In accordance, it may not be surprising that there is little consistency 
in its measurement (Barnhardt & Ginns, 2014; Brown et al., 2003b; (j'aglar, 2012; Carlson, 1995; Hyman, 
Cohen, & Mahon, 2003; Johnson, 2005; Mau, 1992; Murdock, 1999). Although most instruments recognized 
the multidimensional nature of school alienation, it is still obscure whether school alienation is a general or 
rather a domain-specific construct and what are its key elements. Moreover, there is a lack of information 
regarding the validity and reliability of existing instruments that measure school alienation. 

The identification of factors underlying student feelings of school alienation and alleviation of 
unfavorable consequences is important for understanding the true impact alienation may have on school 
success. In the alienation literature, several reasons of school alienation are discussed. Oftentimes, student 
alienation is conceptualized as the result of three experiences. First, school subjects appear irrelevant to some 
students and they rarely see the connection between learning at school and their social realities ((j'aglar, 2013). 
As a result, they estrange themselves from the learning process and develop negative attitudes toward the 
school (Altenbaugh et al., 1995). Second, teachers behave differently toward students in the same classroom 
(Babad, 1992; Hughes, Gleason, & Zhang, 2005; Jussim & Eccles, 1992; Jussim, Eccles, & Madon, 1996; 
McKown & Weinstein, 2008). For example, teachers tend to provide more emotional support, more favorable 
feedback, and more challenging learning opportunities to high achievers. At the same time, they expect 
troublesome behavior from difficult students and impose more restrictive actions upon those students (Baker, 
1998). Accordingly, as a reaction, students may respond to these disciplinary actions with more disobedience 
which in turn may lead to further alienation and distancing from teachers (Kagan, 1990). Third, students feel 
not accepted by their classmates, experiencing non-fulfilment of their psychological and social needs (Baker, 
1998). Peer rejection can result in student academic and socioemotional misfortune in a school environment 
as well as a lack of identification with the school system (Buhs & Ladd, 2001; Ladd, 1999; Ladd, Birch, & 
Buhs, 1999). In other words, alienated students may withdraw from peers, teachers, learning, and eventually 
school itself (Altenbaugh et al., 1995). Research on student withdrawal has also distinguished between the 
academic (e.g., learning, academic performance) and social (e.g., interaction with classmates and teachers) 
domains of the educational institution, suggesting that despite close interrelation between the two domains, a 
student may be integrated into one domain without being sufficiently integrated into the other (Tinto, 1975, 
1993). These theoretical propositions suggest that in a school setting students can be alienated in academic 
and/or social domains. 

Considering the multidimensional nature of the school alienation phenomenon and that attitudes are 
usually directed toward specific situations, objects, or behavior (Honkanen, Verplanken, & Olsen, 2006), this 
study suggests a more holistic approach. Specifically, we propose that school alienation consists of three 
school-related domains — classmates, teachers, and learning — considering them as interrelated but relatively 
independent dimensions. In other words, we address school alienation as a construct of a domain-specific 
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nature. Accordingly, we developed the School Alienation Scale (SALS) as a carefully constructed, 
comprehensive, psychometrically sound, and brief standardized assessment instrument that can be used to 
diagnose students’ negative attitudes toward classmates, teachers, and learning during primary and secondary 
education. More precisely, it measures whether students are alienated from classmates, and/or teachers, and/or 
learning at school. Students may become alienated in one, two, or all three domains. In the latter case, students 
experience negative attitudes toward both social actors and academic aspects of schooling. 


1.2 Rationales for questionnaire construction 

Prior to constructing the SALS to assess student alienation from school, we articulated several basic 
principles. First, we conceptualized the target construct to assure the coherence of the initial item pool. To be 
specific, the three school alienation dimensions of classmates, teachers, and learning comprised both emotional 
(i.e., a student’ feelings toward school) and cognitive (i.e., a student’s beliefs, perceptions, knowledge, 
assumptions, and judgments of school) aspects. Second, we specified the association between these aspects, 
taking into account that historically, cognitive and emotional processes were studied separately (Hilgard, 1980; 
Snow, Corno, & Jackson, 1996). 

For years, psychologists have been trying to solve the “chicken and egg” causality dilemma. However, 
recent research is based on the idea that cognition cannot be separated from individual’s emotions and feelings; 
it tends to examine them as interwoven psychological processes, one leading to another, in an ongoing cycle 
(Dai & Sternberg, 2004; Dweck, Mangels, & Good, 2004; Eisenberg, 2014; Linnenbrink & Pintrich, 2004; 
Pessoa, 2008). There is scientific evidence that positive emotions stimulate rigorous thinking, facilitating 
application of existing knowledge (Isen, 2004). Moreover, emotions are essential not only in the relationship 
between individuals and their environment, but also in group processes, such as group members (for example, 
a school class) sharing similar emotional experiences (Aritzeta et al., 2016). When members of a class feel 
they are a part of the class, they are most likely to pursue common goals (e.g., learning, getting good marks, 
or graduating). Kreitler (2013) likewise perceived emotions as motivational forces that influence activation 
and functioning of cognition. In other words, emotion and cognition are different sides of the same coin, 
working jointly in the process of intellectual functioning (Dweck et al., 2004; Wimmer, 2013; Zihl, Szesny, & 
Nickel, 2013), and do not act independently of each other (Kreitler, 2013). Therefore, in this study we 
scrutinized the complex interplay between emotion and cognition in alliance, and emphasized the difficulty of 
setting boundaries between them. 

Furthermore, we also decided whether school alienation should be measured with general or subject- 
specific items. Recent studies addressed school alienation not as subject-specific, but rather as a general 
negative orientation toward social actors and/or learning in school (Hadjar & Lupatsch, 2010; Hascher & 
Hagenauer, 2010; Hadjar, Backes, & Gysin, 2015). Consequently, in this study we decided to measure school 
alienation at a more general level. Nevertheless, we acknowledge that students’ feelings and beliefs may vary 
depending on school subject (Goetz, Frenzel, Pekrun, & Hall, 2006). 


1.3 Aim and hypotheses 

The current study was designed to illustrate psychometric characteristics of a newly developed self- 
report instrument to assess school alienation among primary and secondary students, based on certain 
theoretical and conceptual considerations. Validity theorists emphasize the importance of constructing a 
cohesive validity argument that integrates several sources of evidence to support the construct validity and use 
of the instrument (AERA, APA, & NCME, 2014). The unitary concept of validity still remains a widely used 
approach (Chan, 2014; Sired, 2009). Therefore, we sought to provide a consistent approach for examining the 
construct validity of the SALS. We first assessed the reliability of the scale in terms of internal consistency of 
the items. We then explored the factorial structure of the SALS and tested several competing models of school 
alienation by means of confirmatory factor analysis. Next, we estimated measurement invariance across two 
cohorts, two countries, and gender to ensure that the instrument possessed the same psychometric 
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characteristics across various groups. Finally, we assessed criterion-related validity, as an additional evidence 
of construct validity, to investigate the relationship between the SALS and external criteria. 

With respect to a suggested construct validity approach, we tested the following hypotheses. 
Recognizing the multidimensional nature of school alienation, we assumed the SALS developed for 
diagnosing student alienation from classmates, teachers, and learning to be reliable (Hypothesis 1). Regarding 
the factorial structure of the SALS, our proposition that students can be alienated from classmates, teachers, 
or learning at school implied that the instrument should depict a three-factor structure. Hence, the measurement 
model tested here hypothesized that responses to the SALS could be explained by three first-order factors — 
classmates, teachers, and learning (see Figure 1, Model 3). It was expected that the specified model could be 
verified and fit the data better than several alternative models (Hypothesis 2). 

Furthermore, with the goal of following individuals over time and comparing groups, an instrument 
should measure the same construct having identical structure across various groups. Therefore, we assessed 
measurement invariance across different contexts (i.e., Switzerland and Luxembourg), grades (i.e., grade 4 and 
grade 7), and gender. By establishing measurement invariance, we provide additional evidence of construct 
validity (Van de Schoot, Lugtig, & Hox, 2012). We assumed the questionnaire was equally suitable for both 
primary and secondary school students (Hypothesis 3) in both Switzerland and Luxembourg (Hypothesis 4) 
and for both boys and girls (Hypothesis 5). However, it is not sufficient to provide only measurement 
invariance for evaluating validity of the measure. 

Criterion-related validity was examined as important evidence of construct validity (Arino, 2003; 
Messick, 1995; Vandenberg & Lance, 2000). The validity of the measurement is also indicated by the 
correspondence of the relationships between the new measure and other variables to theoretical expectations. 
Together with the SALS, we administered other scales, including the Well-Being in School Scale (Hascher, 
2007). In particular, we examined associations between the domains of school alienation and demonstrably 
valid dimensions of well-being (Hascher, 2008; Hascher & Hagenauer, 2011). In keeping with previous 
research on the association of alienation and well-being (Crinson & Yuill, 2008; Dekel & Tuval-Mashiach, 
2012; Hall-Lande, Eisenberg, Christenson, & Neumark-Sztainer, 2007; Ifeagwazi, Chukwuorji, & Zacchaeus, 
2015; Moreno, & de Roda, 2003; Osin, 2009; Vahedi & Nazari, 2011), we expected positive attitudes to school 
and enjoyment in school to be significantly negatively related to the domains of school alienation (Hypothesis 
6). Prior research has shown that when students experience positive emotions during school-related activities 
and interaction with people involved in those activities their alienation decreases (Ifeagwazi et al., 2015). Well¬ 
being is, thus, viewed as a resource for coping with negative impacts on learning and individual development 
(Hascher, 2011, 2012). This implies that social problems in school should be positively related to alienation 
from classmates and teachers (Hypothesis 7). In accordance with Hascher (2010), social discrimination in 
school was found to diminish student well-being and escalate social problems in school. 

Accordingly, the present study was conducted to accomplish three major goals. First, given little 
agreement on the conceptualization of school alienation, we sought to identify the key elements of school 
alienation. Second, considering generally acknowledged multidimensional nature of school alienation, we 
wanted to verify whether school alienation is a general or a domain-specific construct. In addition, we analyzed 
the interplay between emotion and cognition. Third, we also sought to empirically validate the new 
theoretically-based instrument to measure school alienation. A carefully designed and psychometrically sound 
research instrument, based on theory and statistical analysis, would make a valuable contribution to alienation 
research from theoretical, practical as well as methodological standpoints. 
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2. Method 

2.1 Participants and procedures 

Data were collected from two cohorts of primary and secondary school students, attending grade 4 and 
grade 7, respectively. The sample in this study (N = 2,073) consisted of 486 students from primary school 
(47.3% male; M age = 10.3 years [ SD = .98]) and 550 students from secondary school (45.2% male; M age = 13.0 
years [SD = .55]) from the Swiss canton of Bern; and 503 primary school students (54.9% male; M age = 9.7 
years [SD = .75]) and 534 secondary school students (57.8% male; M age = 12.7 years [SD = .65]) from 
Luxembourg. Fifty percent of the students in the Swiss canton of Bern and about 75% of students in 
Luxembourg had a migration background (including first- and second-generation immigrants). 

Both countries have stratified education systems, offering track selection at the secondary level (EDK, 
2015; MENJE & University of Luxembourg, 2015). The majority of secondary school students in Switzerland 
studied in schools with various school tracks and ability groups. Just over half of secondary school students 
(55%) studied in the middle track (Sek), 36% in the lower track (Real), and 8% in the upper track ( Spezsek ). 
On average, primary school students perceived themselves as having good academic performance (M per f= 4.32 
[SD = .46] on a scale from 1 = poor to 5 = very good). Secondary school students defined themselves as having 
above-average academic performance (M pe rf = 3.69 [SD = .57] on a scale from 1 = poor to 5 = very good). 

For the Luxembourgish sample, the largest percentage of students (34%) were from the general 
secondary track ( enseignement secondaire), 25.3% from the technical secondary track ( enseignement 
secondaire technique), 23.2% from the lowest technical secondary track ( regimepreparatoire/modulaire), and 
17% were from the project track PROCI {projet pilote “cycle inferieur” de Venseignement secondaire 
technique), a comprehensive track within technical secondary education with heterogeneous ability levels. 
Primary school students, on average, perceived themselves as having good academic performance (M per f= 4.05 
[SD = .53]), whereas secondary school students described themselves as having above-average academic 
performance (M per f = 3.72 [SD = .58]). 

Contacts to schools were established through school principals and teachers, who were provided 
general information about the project, its goals, and benefits of participating. In the former case, principals 
decided together with teachers about their participation in the study. In the latter case, we contacted teachers 
directly. Once agreement was reached, we informed school principals about teachers’ consent to engage in a 
project. Random sampling of schools or classes was not possible, because of a high risk of dropout. A main 
sampling criterion was heterogeneity in regard to institutional school characteristics, school composition 
(migrant population, ability levels), and industrial versus rural areas. In collaboration with teachers, students 
received informed consent forms addressed to their parents, indicating voluntary participation, assurance of 
anonymity, and confidentiality. Small incentives were given to participants during school break time and after 
the survey, because incentives were found to motivate respondents and thus increase the response rate (Singer 
& Couper, 2008). 

2.2 Measures 

The new paper-and-pencil school alienation questionnaire was developed by applying a well- 
established systematic framework designed to produce reliable and valid scales (Flinkin, Tracey, & Enz, 1997). 
The first crucial step in scale construction involved the creation of the initial pool of items meant to cover each 
content area relevant to the target construct and the sample. The items were developed by experienced theorists 
and researchers in the field based on the existing instruments (Hadjar & Lupatsch 2010; Hascher & Hagenauer 
2010). The wording of each item was thoroughly discussed, to eliminate potential sources of construct- 
irrelevant variance. A typical item represented a statement in regard to general positive or negative student 
feelings and thoughts toward classmates, teachers, and learning (e.g., “What we learn in school is boring”). 
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Prior to application, a pilot study was conducted to test the developed instrument in Luxembourg and 
the Swiss canton of Bern. The pilot study examined how well the new measure reflected our expectation 
regarding its psychometric properties, and evaluated whether the construct of interest operated equivalently 
across two groups. After an initial assessment of the scale’s reliability and validity, irrelevant, similar, or 
ambiguous items were eliminated from the study (e.g., “When I get bad grades, 1 do not feel good”, “1 wonder 
why working with a partner and group work are meaningful”). Accordingly, the final version of the SALS 
(consisting of 39 items, with 12-14 items per school alienation domain) was administered to assess school 
alienation among primary and secondary school students. A typical item represented a statement in regard to 
student feelings and thoughts toward classmates, teachers, and learning. An example of an item of alienation 
from the classmates scale is: “In my class 1 feel like someone who doesn’t fit in”; alienation from the teachers 
scale: “I do not feel taken seriously by my teachers”; alienation from the learning scale: “I don’t find pleasure 
in learning at school”. For each item, students responded on a 4-point Likert scale with the endpoints 1 = 
disagree to 4 = agree. We chose this scale format to reach a specific respondent opinion; therefore, we 
eliminated the mid-point on the scale. In addition, shorter scales are relatively quick to use (Preston & Colman, 
2000). However, prior research has shown that there is often a give-and-take between scale reliability and ease 
of administration (as cited in 0steras et al., 2008). Several items in the survey were phrased in the reverse to 
force participants to carefully read the questions and to prevent the tendency to agree with a statement or 
respond in the same pattern throughout the questionnaire. 


3. Results 


3.1 Descriptive statistics and reliability analysis 

Prior to conducting statistical analyses, we calculated the amount of missing data across the variables 
analyzed in this study to ensure robust data analysis. The largest amount of missing data was less than 3%, 
which meant that accurate statistical estimates could be obtained (Acuna & Rodriguez, 2004). 

The reliability of the SALS was measured in terms of the internal consistency of the items and analyzed 
by calculating Cronbach’s alpha (Hypothesis 1), using the Statistical Package for the Social Sciences (SPSS) 
Software Version 23. Using subsamples from primary and secondary school students in the Swiss canton of 
Bern, we conducted a reliability analysis by means of stepwise exclusion of the items with the lowest corrected 
item-total correlation. We then applied a series of factor analyses for all four subsamples to verify the factorial 
structure of the scale. Based on factor analysis and internal consistency of the items, 24 items, with 8 items 
per each school alienation domain, were selected for the final scale. The descriptive statistics for these 24 items 
and the school alienation scales are shown in Table 1. The Cronbach’s alpha coefficients ranged from a = .74 
to a = .88 for all study participants. The results of the reliability analyses confirmed Hypothesis 1. 

Table 1 

Descriptive Statistics of School Alienation Scales 


Primary school (n - 486) _ _ Secondary school (n = 550) 



M 

SD 

a 

S(SE) 

K(SE) 

M 

SD 

a 

S(SE) 

K(SE) 

Classmates 

1.48 

.43 

.79 

1.27(.l 1) 

1.45(.22) 

1.52 

.46 

.83 

1.45(.ll) 

2.50(.21) 

Teachers 

1.42 

.45 

.77 

1.58(.l 1) 

3.29(.22) 

1.57 

.48 

.79 

111(11) 

1.39(.21) 

Learning 

1.54 

.52 

.87 

1.34(.l 1) 

2.14(.22) 

1.83 

.56 

.88 

1.13(.ll) 

1.63021) 

Luxembourg 


Primary school (n = 503 ) 



Secondary school (n = 534) 

M 

SD 

a 

S(SE) 

K(SE) 

M 

SD 

a 

S(SE) 

K(SE) 

Classmates 

1.56 

.50 

.74 

1.29(.ll) 

1.58(.22) 

1.60 

.52 

.84 

1.25(.U) 

1.30(.21) 

Teachers 

1.61 

.59 

.79 

1.10(.ll) 

0.89(.22) 

1.77 

.59 

.83 

0.90(. 11) 

0.66(.21) 

Learning 

1.54 

.56 

.82 

1.49(.ll) 

2.23(.22) 

1.87 

.60 

.86 

0.65(.ll) 

0.17021) 


Note. M = mean; SD = standard deviation; a = Cronbach’s alpha; S = skewness; K = kurtosis; SE = standard error. 
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Intercorrelations of the school alienation factors for primary and secondary school students in both 
countries are reported in Table 2. Correlation coefficients displayed a positive association among the three 
domains of school alienation and represented small to high effects, indicating that the factors were conceptually 
and statistically distinguishable. 


Table 2 

Correlations among the Domains of School Alienation 




Canton of Bern 



Luxembourg 



1 

2 

3 

1 

2 

3 

1. Classmates 

- 

.37**(.45**) 

.23**(.23**) 

- 

.35** (.39**) 

.24** (.27**) 

2. Teachers 

,44**(.55**) 

- 

.50**(.56**) 

.38** (.48**) 

- 

.49** (.56**) 

3. Learning 

.25**(.29**) 

40** (. 44 **) 

- 

.27** (.33**) 

.51** (.57**) 

- 


Note. Values below the diagonal represent intercorrelations for primary school students (n = 486 students, canton of 
Bern; n = 503 students, Luxembourg) and values above the diagonal represent intercorrelations for secondary school 
students (n = 550 students, canton of Bern; n = 534 students, Luxembourg). Latent correlations revealed by CFAs are 
presented in parentheses. **p < .01. 

3.2 Factorial structure of the SALS 

Prior to analyzing the factorial structure of the SALS, the data were screened to assure their 
appropriateness for confirmatory factor analysis (CFA) and the statistical estimator. The results from a 
Shapiro-Wilk test of normality, which considers the values of both Skewness and Kurtosis simultaneously, 
revealed that the data significantly deviate from a normal distribution (/; < .05). Some indicators demonstrated 
substantial non-normality, thereby weakening the assumption of multivariate normality. Having non-normal 
continuous indicators, we applied an estimator with robust standard errors and a chi-square test statistic, i.e., 
robust maximum likelihood estimation method (MLR), to achieve reliable statistical results (Brown, 2015). 
This allows evaluating models with missing data and provides parameter estimates, which are robust to non¬ 
normality (Brown, 2015). All analyses were based on covariance structures and applied robust maximum 
likelihood estimation. 

By applying CFA using software package Mplus Version 7.31, we assessed the internal validity of the 
SALS. In other words, we explored whether the SALS combined the variables that were collinear and belonged 
to the same underlying variable due to their mutual association. We estimated a range of the most significant 
fit indices as measures of model fit (Schermelleh-Engel, Moosbrugger, & Muller, 2003), including the chi- 
square test statistic, the root mean square error of approximation (RMSEA), the comparative fit index (CFI), 
and the standardized root mean square residual (SRMR). The following typical criteria were applied to assess 
the adequacy of model fit: CFI of close to .95, RMSEA and SRMR of close to .05 (Hu & Bender, 1999; 
Schermelleh-Engel et al., 2003), and % 1 /df< 2 (Hair, Anderson, Tatham, & Black, 1995; Schermelleh-Engel 
et al., 2003). In addition, we performed the chi-square difference tests to compare several competing models 
against each other. 

In the first confirmatory factor analysis, we assessed the hypothesized measurement model (see Figure 
1, Model 3). It incorporated the three factors of school alienation, i.e., classmates, teachers, and learning, each 
consisting of 8 items. Within each domain, several items were used to indicate an emotional component and 
other items were used to indicate a cognitive component. The three factors were free to correlate. As can be 
seen in Table 3, the hypothesized model indicated a very good fit for primary as well as secondary school 
students in both Luxembourg and the Swiss canton of Bern. Completely standardized item loadings on the 
three factors of school alienation were all statistically significant and above .50 (primary school in both 
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countries) and .57 (secondary school in both countries). Latent correlations among the three school alienation 
factors were moderate, reaching on average .50 for all subsamples. 

Model 1 


SCHOOL ALIENATION 

m m i \ 

DDDDDDDI DDDDDDDO DD1DQDDD 

CLASSMATES TEACHERS I.KAKNINC 


Model 2 



Model 3 


SCHOOL ALIENATION 



Model 4 

SCHOOL ALIENATION 



Figure 1. First-order one-factor (Model 1), second-order with three facets included (Model 2), hypothesized first-order 
three-factor (Model 3), and second-order with six facets included (Model 4) models potentially underlying the SALS. 


3.3 Competing models of school alienation 

Facilitating the assessment of the factorial validity of the SALS, we evaluated three alternative models 
against the hypothesized Model 3 (see Figure 1, Models 1, 2, 4). The models were subsequently compared in 
regard to their model fit by applying chi-square difference testing using the Satorra-Bentler scaled chi-square, 
in which the usual chi-square statistic is divided by a scaling correction to better approximate chi-square under 
non-normality (Brown, 2015). In Model 1, we assessed whether the data could be better described by an overall 
construct of school alienation in which no factors of school alienation were assumed. In Model 2, we specified 
that three school alienation domains load on one higher-order school alienation factor. Model 4 postulated that 
emotional and cognitive components comprised each of the three school alienation domains. 

As can be seen in Table 3, none of the competing models provided a better fit to the data than the 
hypothesized first-order three-factor model for both primary and secondary school students in either 
Luxembourg or the Swiss canton of Bern. In both groups, chi-square difference tests revealed that the 
comparison between Model 1 and Model 3 was highly significant (p < .01), indicating that Model 3 fits the 
data better than Model 1. Comparing Model 2 and Model 3, in all subgroups except for primary school in the 
canton of Bern, the chi-square difference test was statistically non-significant; this indicated that both models 
fit statistically equally well. The corrected difference test between Model 3 and Model 4 generated statistically 
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insignificant values (p > .01), indicating that the fit of the restricted model (Model 3) was not significantly 
worse than the fit of the unrestricted model (Model 4; see Table 3). In other words, both models function 
equally across the Swiss and the Luxembourgish primary and secondary school samples. Thus, the null 
hypothesis of equal fit for both models cannot be rejected. In addition, a confirmatory factor analysis of Model 
4 revealed latent correlations between emotional and cognitive components in each of the three domains of 
school alienation. These correlations almost reached a perfect positive correlation (above .90), which indicates 
that both components undergo the same directional change. On the basis of these findings and theoretical 
considerations, we believe that emotional and cognitive components could be viewed as a single factor, as 
specified in Model 3. In keeping with Hypothesis 2, the hypothesized Model 3 is verified and fits the data 
better than alternative models. 


Table 3 

Goodness of Fit Indices for the Four Models of the SALS 


Canton of Bern 


Model 

r 

df 

X 2 /df 

CFI 

RMSEA 

SRMR 

Model 

Comparison 

Ar 

A df 

P 

Primary School (n = 
Model 1 

486) 

996.28 

246 

4.05 

.70 

.08 

.10 





Model 2 

417.11 

244 

1.71 

.93 

.04 

.06 

2 vs. 3 

25.91 

1 

<.01 

Model 3 

401.29 

243 

1.65 

.94 

.04 

.05 

3 vs. 1 

319.84 

3 

<.01 

Model 4 

401.44 

242 

1.66 

.94 

.04 

.05 

4 vs. 3 

0.46 

1 

NS 

Secondary School (n 
Model 1 

= 550) 
1377.88 

246 

5.60 

.69 

.09 

.11 





Model 2 

471.49 

244 

1.93 

.94 

.04 

.05 

2 vs. 3 

0.27 

1 

NS 

Model 3 

471.56 

243 

1.94 

.94 

.04 

.05 

3 vs. 1 

597.97 

3 

<.01 

Model 4 

468.28 

242 

1.94 

.94 

.04 

.05 

4 vs. 3 

2.95 

1 

NS 


Luxembourg 


Model 

r 

df 

X 2 !df 

CFI 

RMSEA 

SRMR 

Model 

Comparison 

A x 2 

A df 

P 

Primary School (n = 
Model 1 

503) 

825.85 

246 

3.36 

.73 

.07 

.08 





Model 2 

360.34 

244 

1.48 

.95 

.03 

.05 

2 vs. 3 

0.30 

1 

NS 

Model 3 

360.56 

243 

1.48 

.95 

.03 

.05 

3 vs. 1 

197.72 

3 

<.01 

Model 4 

356.80 

242 

1.47 

.95 

.03 

.05 

4 vs. 3 

2.92 

1 

NS 

Secondary School (n 
Model 1 

= 534) 
1465.46 

246 

5.96 

.65 

.10 

.11 





Model 2 

451.97 

244 

1.85 

.94 

.04 

.05 

2 vs. 3 

0.14 

1 

NS 

Model 3 

452.10 

243 

1.86 

.94 

.04 

.05 

3 vs. 1 

789.81 

3 

<.01 

Model 4 

447.44 

242 

1.85 

.94 

.04 

.05 

4 vs. 3 

4.05 

1 

NS 


Note. See Models in Figure 1. CFI = comparative fit index; RMSEA = root mean square error of approximation; SRMR 
= standardized root mean squared residual; tsjf and A df = changes in chi-square and degrees of freedom between the 
hypothesized and competing models. 
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3.4 Measurement invariance 

Pursuing the goals of evaluating the recently constructed research instrument and facilitating cross- 
cultural research, we tested measurement invariance across primary and secondary school students in 
Luxembourg and the Swiss canton of Bern (Hypotheses 3 and 4) using multigroup confirmatory factor 
analyses. It is broadly recognized as one of the most successful and multilateral approaches to testing 
measurement invariance across specific groups of interest (Steenkamp & Baumgartner, 1998). Examining 
measurement invariance through a series of models, we investigated whether the instrument possesses the 
same psychometric characteristics across various groups (Milfont & Fischer, 2010; Schmitt & Kuljanin, 2008). 

This procedure included testing hierarchically arranged models: (a) a configural invariance model, (b) 
a metric invariance model, (c) a scalar invariance model, and (d) a residual invariance model. First, configural 
invariance indicated whether respondents from Fuxembourg and the Swiss canton of Bern considered the 
construct of interest in a similar fashion, assuming the same item to be associated with the same latent factor 
in each group (Milfont & Fischer, 2010). In this model, none of the parameters were constrained to be equal 
across the groups. All subsequent models in testing for invariance were compared against the fit of the 
configural model, serving as a baseline value (Byrne, 2012). At each step of the measurement invariance test 
procedure, earlier specified constraints remained in force. In the next step, metric invariance was required to 
test the equivalence of item factor loadings across the two groups, namely, whether participants in different 
groups assigned the same meaning to the items of a latent construct. Previous research has shown that at least 
partial metric invariance must be confirmed prior to conducting the subsequent tests (Vandenberg & Lance, 
2000). Furthermore, scalar invariance, constraining item intercepts to be the same across groups, was a 
prerequisite for the comparison of latent means between groups. Finally, having all previous constraints in 
place, we applied residual invariance to test the equivalence of measurement error for each item between 
groups (Byrne, 2012; Chen, Sousa, & West, 2005; Milfont & Fischer, 2010). 

Following the recommendations for testing measurement invariance with an adequate sample size that 
is equal between the groups (N > 300; Chen, 2007), we compared the three fit indices (i.e., CFI, RMSEA, and 
SRMR) across all invariance models. In compliance with the suggested guidelines, for testing metric 
invariance, a change of > -.010 in CFI, complemented by a change of > .015 in RMSEA, or a change of >030 
in SRMR indicates noninvariance; for testing scalar or residual invariance, a change of > -.010 in CFI, in 
addition to a change of > .015 in RMSEA, or a change of >010 in SRMR indicates noninvariance. In both 
primary and secondary school samples, ACFI, ARMSEA, and ASRMR were evidently below the 
recommended cutoff values, and each of the four invariance models produced an acceptable fit (see Table 4). 
The chi-square difference test between Model 3 and Model 2 in both samples was significant (A^ 2 = 130.43, 
A elf - 24, p < .001; A^ 2 = 170.53, A df- 24, p < .001, respectively). Given that the test was based on large 
samples {n v „ m - 989; n sec - 1,084) and the decrease in CFI was below .01, we concluded that there was no 
substantial difference between Fuxembourgish and Swiss students on the intercepts of the measured variables 
(see Ong & van Dulmen, 2006). Based on the three indicators, metric, scalar, and residual invariance between 
the Fuxembourgish and Swiss primary and secondary school students was confirmed, revealing the 
equivalence of loadings, intercepts, and residuals across the two countries. Consistent with Hypotheses 3 and 
4, results suggest that the questionnaire works equally well for primary and secondary school students in both 
Fuxembourg and Switzerland. 

Finally, after confirming that the instrument possesses the same psychometric characteristics across 
two countries, we tested measurement invariance across male and female students in primary and secondary 
schools (Hypotheses 5). Based on the goodness-of-fit statistics, all four models provided an acceptable fit (all 
RMSEAs were below .05 and all CFIs were above .90; Schermelleh-Engel et al., 2003). Thus, the assumption 
of measurement invariance cannot be rejected, indicating that the SALS is measurement invariant for gender 
across primary and secondary schools. 
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Table 4 

Measurement Invariance Tests for the Three-Factor Model of School Alienation across Swiss and 
Luxembourgish Primary and Secondary School Students 



Model 


Overall Fit Indices 


Model 

Comparative Fit Indices 


r 

df 

CFI 

RMSEA 

SRMR 

Comparison 

Ar 

A df 

ACFI 



Swiss (n 

= 486) and Luxembourgish (n 

= 503) primary school sample 




1 . 

Configural invariance 

761.35 

486 

.94 

.04 

.05 

_ 

_ 

_ 

_ 

2 . 

Metric invariance 

803.92 

507 

.94 

.04 

.05 

2 vs. 1 

40.66 

21 

.00 

3. 

Scalar invariance 

915.07 

531 

.93 

.04 

.06 

3 vs. 2 

130.43* 

24 

.01 

4. 

Residual invariance 

929.35 

537 

.93 

.04 

.06 

4 vs. 3 

13.31 

6 

.00 



Swiss (n = 

: 550) and Luxembourgish (n = 

534) secondary school sample 




1 . 

Configural invariance 

923.31 

486 

.94 

.04 

.05 

- 

- 

- 

- 

2 . 

Metric invariance 

949.64 

507 

.94 

.04 

.05 

2 vs. 1 

28.31 

21 

.00 

3. 

Scalar invariance 

1099.31 

531 

.93 

.05 

.06 

3 vs. 2 

170.53* 

24 

.01 

4. 

Residual invariance 

1103.59 

537 

.93 

.04 

.06 

4 vs. 3 

5.79 

6 

.00 


Note. CFI = Comparative fit index; RMSEA = root mean squared error of approximation; SRMR = standardized root 
mean square residual; A = difference between the comparison and nested model. ARMSEA and ASRMR were explicitly 
below the recommended cutoff values. *p < .001. 


3.5 External validity of the SALS 

To provide additional evidence of construct validity, we estimated the relationship between the SALS 
and external criteria by means of correlational evidence. Criterion-related evidence is viewed as a gold standard 
in validation research (Chan, 2014; Kane, 2001; Sireci, 2009). Well-being dimensions were chosen as criterion 
variables from Hascher’s (2004) questionnaire on subjective well-being in school (Donat, Peter, Dalbert, & 
Kamble, 2016; Hascher, 2007, 2008, 2010; Hascher & Hagenauer, 2011). The scale was validated in four 
countries, namely, Germany, Switzerland, the Czech Republic, and the Netherlands (Hascher, 2007). 
Specifically, we examined the relationship between the school alienation domains and (a) enjoyment and 
positive attitudes to school (Hypothesis 6) and (b) social problems in school (Hypothesis 7). These well- 
defined measures demonstrated high quality and reliability in prior research (Hascher, 2008; Hascher & 
Hagenauer, 2011). The strength of the relationships between the SALS and the external criteria based on a 
Spearman’s test is presented in Table 5. Strength of association indices was interpreted according to Cohen 
(1992). The pattern of correlations between the school alienation domains and well-being dimensions was 
highly alike between the Luxembourgish and Swiss samples. In keeping with our expectations, there were 
weak to strong significant negative associations between the domains of school alienation and the three 
positive well-being dimensions (positive attitudes toward school, enjoyment in school, and academic self- 
concept). Specifically, correlation coefficients between each of the domains of school alienation and positive 
attitudes toward school ranged from r = -.24 (p < .01) to r = -.59 (p < .01) in the Swiss canton of Bern and 
from r = -.26 (p < .01) to r = -.55 {p < .01) in Luxembourg. Furthermore, there were weak to medium positive 
associations between alienation from classmates/teachers and social problems in school in both countries (r = 
.17 - .45, p < .01). In addition, a small positive correlation was discovered between alienation from 
classmates/teachers and worries in school, whereas physical complaints had a weak positive association with 
all three domains of school alienation. 
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Table 5 

Correlations between the Factors of School Alienation and Dimensions of School-Specific Well-Being 




Canton of Bern 



Luxembourg 


Classmates 

Teachers 

Learning 

Classmates 

Teachers 

Learning 

Positive Attitudes 

-.24**(-.28**) 

-,30**f-.33**) 

-.59**1-.54**) 

-,26**l-.29**) 

- 32**(- 41 **) 

-.51 **(-.55**) 

Enjoyment 

- 23**(- 17**) 

-.34*%.30**) 

_ 43**(_ 42 **) 

-23*%28**) 

-,30**(-.44**) 

-,37**(-.48**) 

Self-Concept 

_ 23**) 

-.22**f-.25**) 

-,26**l-.28**) 

-. 11 * (-.18**) 

-.27*%.30**) 

-,24**(-.28**) 

Worries 

.09% 19**) 

.14**1.16**) 

-.02 (.03) 

.05 (.13**) 

. 16**(. 14**) 

.05 (.02) 

Physical Complaints 

.11% 17**) 

.16**1.21**) 

.05 (.11**) 

.08 (.24**) 

2 i**( 34 **) 

1 8 **( 13 **) 

Social Problems 

.35*%39**) 

22 **( 17 **) 

.10*1.08) 

.36**1.45**) 

30**(26**) 

20**(.09*) 


Note. Values without brackets represent correlations for primary school students (n = 486 students, canton of Bern; n = 
503 students, Luxembourg) and values within brackets represent correlations for secondary school students (n = 550 
students, canton of Bern; n = 534 students, Luxembourg). *p < .05. **p < .01. 


4. Discussion and conclusion 

This study investigated the reliability and validity of a newly developed scale intended to measure 
school alienation (School Alienation Scale, SALS). School alienation was operationalized as student alienation 
from the most relevant domains in the context of schooling, namely, classmates, teachers, and learning. To our 
knowledge, to date there has been a dearth of well-crafted evaluations of student alienation from school (Brown 
et al., 2003b). Thus, this research enriches previous studies on school alienation and presents a comprehensive 
and psychometrically sound standardized measurement instrument to assess school alienation. The instrument 
consistently demonstrated strong psychometric properties, external validity, and measurement invariance 
across two countries — Luxembourg and Switzerland. We applied a binational approach to validate the 
construct of school alienation in two countries with different educational systems, thus contributing to 
comparative research and the generalizability of the study results. Our study furthermore considers both social 
actors and academic aspects of schooling as well as the state-of-the-art research on the interplay between 
emotional and cognitive processes (Dai & Sternberg, 2004; Linnenbrink & Pintrich, 2004; Pessoa, 2008). 

School alienation emerged in three distinct but closely related domains. In accordance with the theory, 
the results of this study supported prior research that school alienation stems from three experiences. First, 
alienation from teachers reflects the idea that poor interactions between students and teachers, whom students 
may perceive as being unmotivated, nonsupportive, and disrespectful, facilitate development of alienation 
(Hascher, 2010; Kagan, 1990; Legault et al., 2006). Second, students alienated from classmates are exposed 
more than most adolescents to social isolation and have fewer important relationships with other people; they 
experience academic misfortune and a lack of identification with a school environment (Buhs & Ladd, 2001; 
Ladd, Birch, & Buhs, 1999). Third, students alienated from learning are less likely to participate in school 
lessons and learning activities; they experience a negative association with the educational environment and 
perceive school life as worthless (£aglar, 2013; Carlson, 1995). However, social relations might mediate the 
relationship between negative school experience and alienation (Hascher, 2010). In each of the three school 
alienation domains, we have found an almost perfect positive correlation between emotional and cognitive 
components, indicating that cognition and emotion are interwoven psychological processes and undergo the 
same directional change. 

The results of the reliability analysis supported Hypothesis 1, indicating the SALS to be a reliable 
measure of school alienation. The three subscales of the SALS, namely, alienation from classmates, teachers, 
and learning, displayed acceptable to very good reliability for both primary and secondary school students in 
both countries. Furthermore, a series of confirmatory factor analyses supported the postulated structure of the 
SALS, affirming its theoretical and scale validity. The hypothesized first-order three-factor model was 
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particularly superior to three alternative models (Hypothesis 2 confirmed). This finding contributes to 
alienation research, indicating that students can be alienated from classmates, teachers, and/or learning at 
school. Although the three domains of school alienation were found to be correlated, there is no solid ground 
for a one-factor solution, implying that the factors of school alienation are conceptually and statistically 
distinguishable. This argues that no strong hierarchical structure underlies the SALS factors. We, therefore, 
provided additional evidence that school alienation can be addressed as a multidimensional domain-specific 
construct. Furthermore, even though the proposed competing model (in which emotional and cognitive 
components were considered as separate facets of school alienation domains; Model 4) fitted the data 
reasonably well, this study revealed that emotion and cognition are interwoven psychological processes. 
Nearly perfect positive correlations between emotional and cognitive components provided evidence that 
emotional and cognitive processes are closely related and cannot work independently of each other (Dai & 
Sternberg, 2004; Eisenberg, 2014; Kreitler, 2013). Integrated understanding of intellectual functioning might 
be achieved through applying neurobiologic al approaches, which are generally disregarded in psychological 
research (Dai & Sternberg, 2004). Applying the longitudinal cohort-sequential design, we will significantly 
improve the validity of conclusions suggested in this study. 

With regard to Hypotheses 3, 4, and 5, this study revealed the measurement invariance of the three- 
factor model across Luxembourgish and Swiss primary and secondary school students and across gender 
(Hypotheses 3, 4, and 5 confirmed). These findings suggested that respondents from Luxembourg and the 
Swiss canton of Bern considered the construct of school alienation similarly and assigned the same meaning 
to the items. Support for scalar invariance indicated that the latent means can be significantly compared across 
groups (Milfont & Fischer, 2010). Finally, the same level of measurement error was found for each item 
between groups, confirming residual invariance. Thus, the hypothesized three-factor model was found to be 
appropriate for both primary and secondary school students and may be used with both populations, regardless 
of student’s gender. 

In keeping with the idea that alienated youth are exposed to both physical and emotional disease 
(Farrow, 1991), the domains of school alienation could be associated with the dimensions of well-being. 
Consistent with Hypotheses 5 and 6, the SALS had a significant negative correlation to enjoyment and positive 
attitudes to school and a positive correlation with social problems in school. These significant moderate 
correlations were similar across the Swiss and Luxembourgish samples, providing additional evidence of the 
new instrument’s validity. Thus, these findings indicated that the SALS had robust criterion-related validity; 
that is, the more individuals feel good and evaluate their current situation positively, the lower the level of 
their alienation (Vahedi & Nazari, 2011). For example, when students appreciate activities and settings as well 
as value people in these settings, their alienation decreases and their psychological well-being increases 
(Ifeagwazi et al., 2015). In contrast, social discrimination in the classroom was found to lessen student well¬ 
being and intensify social problems in school (Hascher, 2010), because it is especially in adolescence that 
students experience a keen desire for peer interactions and want to be accepted by peers (Rubin, Bukowski, & 
Parker, 1998; Safipour et al., 2011). Social alienation, in turn, was found to be one of the possible risk factors 
for health (Safipour et al., 2011). Research on well-being suggested that social support, positive interactions, 
and integration into the classroom maintained by teachers and classmates might stimulate student well-being 
(Hascher, 2010), thus diminishing their alienation from school and increasing their probability of becoming 
productive citizens. Applying a longitudinal design, further research could explore the transition from 
childhood to adulthood, when young people replace childish behavior with more mature behavior and which 
in turn may affect adolescent’s psychological well-being (as cited in Safipour et al., 2011). 

Although the hypothesized model and research hypotheses were supported, we identified several 
limitations of the present study. First, participation in this study was voluntary, assuming that the study sample 
might be biased. Given that prior to filling out a questionnaire we obtained written parent permission, it is 
possible that alienated students were underrepresented in the current study sample. We also recognize that 
there are limitations in regard to the instrument development process. Some items in the initial scale 
administered to students during the pilot study behaved differently for the Swiss and Luxembourgish samples, 
which resulted in substantial scale reduction. Although each item represented a particular situation, participants 
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in Luxembourg and the Swiss canton of Bern might interpret items differently according to their feelings and 
thoughts toward classmates, teachers, and learning. 

Since we were able to show that the final SALS operated in the same way across primary and 
secondary school students in Luxembourg and the Swiss canton of Bern, it is reasonable to expect cultural 
differences between the initial and new populations. We suggest that future studies include cognitive 
interviews with the participants during the pilot testing phase to obtain students’ understanding of items and 
indicate problematic items for the new sample, or ascribe any difficulties with the test instructions to cultural 
differences. Further, cognitive interviews provide researchers with additional evidence regarding differences 
in item responses among participants from different samples. However, we assume that cognitive interviews 
could have influenced students’ daily school life, because think-aloud conditions trigger participants to reflect 
upon their relationships with classmates and teachers as well as their attitudes toward learning. 

In addition to the questionnaire, it would be useful to include a student standardized diary, in which 
students could specify their feelings and perceptions regarding classmates, teachers, and learning. This 
research method, which is strongly recommended to be applied more frequently in educational settings 
(Schmitz & Wiese, 2006), would allow us to observe students’ attitudes over time between different 
measurement time-points. Asking students to report their experiences in diaries would enable us to gain insight 
into participants’ stances and give the students an opportunity for self-reflection. We believe that after rigorous 
preparation, both a questionnaire and a student diary might be administered using a computer. 

Moreover, despite the confirmation of the proposed model, further domains of alienation, such as 
parental alienation (Kelly & Johnston, 2001; Kocayoriik & §im§ek, 2015), may be useful for the analysis of 
school alienation. Separation or divorce may lead to parental alienation syndrome expressed in children’s 
estrangement from their parents. In this sense, alienated children experience unreasonable negative feelings 
and beliefs toward one of their parents as a reaction to parents’ divorce (Kelly & Johnston, 2001). This 
syndrome might undermine not only parent-child and other interpersonal relationships, but also students’ 
school performance and engagement with the school environment (Kocayoriik & §im§ek, 2015). In addition, 
parental attitudes toward school may also affect students’ feelings about school (Ames, de Stefano, Watkins, 
& Sheldon, 1995). Children tend to imitate parents’ behavior and later adopt it as their own (Parsons, Adler, 
& Kaczala, 1982). For example, parents’ active participation and interest in what their children are learning 
have been found to enhance students’ value of education and their academic motivation (Gonzalez-DeHass, 
Willems, & Holbein, 2005). Longitudinal studies can reveal the development of school alienation, its causes, 
and consequences for students and education in general. 

To conclude, the present study indicates that the SALS can be used as a valid and reliable research 
instrument in a variety of educational settings. The main finding of this study is that the hypothesized first- 
order three-factor model, incorporating three school-related domains, namely, alienation from classmates, 
from teachers, and from learning, was confirmed. This finding is especially noteworthy because the disclosure 
of the core elements of school alienation, conceptually and statistically distinguishable, may contribute to 
further research and praxis. We also found that emotional and cognitive components of school alienation 
domains cannot be considered separately. The results of this study further show a negative association between 
school alienation domains and positive attitudes toward school; and a positive association between school 
alienation and social problems in school. This is the first study to clarify the defining elements of school 
alienation supporting the theoretically derived assumptions about the phenomenon of school alienation (see 
Hascher & Hadjar, 2017). The results demonstrate the importance of detecting alienation symptoms among 
students in each of the three school alienation domains, as well as their causes and consequences. 
Understanding the school alienation phenomenon at different stages of development represents an important 
step in designing school-based prevention strategies to increase student well-being and academic success. 
While we know that the construct of school alienation operates equivalently in different educational contexts, 
it is necessary to observe the development of school alienation across time. In subsequent research, we need 
to apply a longitudinal cohort-sequential design and broaden our understanding of the school alienation 
phenomenon. 
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Keypoints 

We developed and validated a new 24-item questionnaire, the School Alienation Scale (SALS), to 
measure school alienation among primary and secondary school students. 

9 We disclosed the core elements of the school alienation construct: alienation from classmates, 
teachers, and learning. 

We contributed to comparative research by validating the construct of school alienation in different 
educational settings. 

• Carefully constructed, psychometrically sound, and brief multidimensional assessment instrument 
is practical for use in future studies. 
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